Evaluating Learning Support Systems Usability An Empirical Approach

Usability is a key attribute affecting information technology systems acceptance and adoption by users in instructional settings. This is due to the system’s role as communication mediator between instructors and learners. Indeed, a basic condition for usable e-learning systems is that users are able to concentrate on content and not on system issues. This demands an integrated, systematic and user-based evaluation approach to help designing learning-centered experiences. However, usability in educational support systems is also affected by contextual factors. Thus, methods that address both the technical and pedagogical dimensions in context of use are still a research issue. These methods will help organizations who want to remain competitive, identify which factors are the most important when adopting technologysupported learning solutions while gradually evolving towards an effective learning process. In this paper, we describe an integrated usability evaluation method empirically tested within an instructional setting in our university. We developed a system prototype to support the internal teaching process and evaluated its role in a technology-supported learning experience. Our results indicate that an e-learning system must adequately meet the needs of the instructional process and support learners’ behaviors and actions. These results also show that consistent online and offline communication between stakeholders is crucial to achieve learning effectiveness. While describing ongoing research, we expect that this contribution will provide insights and better understanding on how to evaluate and improve e-learning systems’ usability based on learners’ feedback and usage patterns.